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Automated Measurement of Objects Using Deformable Models 

The present invention relates to a method for determining geometrical properties of a 
structure of an object displayed in an image. Furthermore, the present invention relates 
5 to a method for determining a deformable model for adaptation to an object, to an image 
processing device and to a computer program for an image processing device for 
determining geometrical properties of an object. 

The present invention relates in particular to the automated measurement of geometrical 
10 properties of anatomical objects using deformable models in the field of medical digital 
imaging. The increasing availability of 3D medical image data improves diagnostics and 
treatment possibilities dramatically. Due to the size and complexity of large 3D datasets, 
automated tools for quantitative measurements are important for fast, accurate and 
reproducible analysis of such image data in daily clinical routine. For example, 
15 applications include orthopaedic diagnosis and treatment (e.g. define and measure 

geometrical properties of bones in CT), or cardiac imaging (e.g. extract the location of 
specific axes required for scan-plane-planning in MR). 

Manual definition and measurement of geometrical properties (e.g. the long axis of a 
20 femur shaft, the short axis of the left heart ventricle) based on image data is time 

consuming, subjective, and error prone, and therefore not clinically practical. A first 
step towards the automatic measurement is the extraction of the object surface, e.g. by 
adapting a deformable, parametric surface model to the object of interest. Methods of 
this kind are known, for example, from J. Weese et al. "Shape constrained deformable 
25 models for 3D medical image segmentation 9 ' 17 th International Conference on 

Information Processing in Medical Imaging (IPMI), pages 380-387, Davis, CA, USA, 
2001, Springer Verlag, and T. Mclnerney et al. "Deformable models in medical image 
analysis: A survey" in Medical Image Analysis, 1(2):91-108, 1996. After initial 
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placement of the deformable model by an operator with, for example, a mouse, the 
model is iteratively deformed until it matches the surface of the object to be measured. 
However, often the measurement of geometrical properties cannot readily be derived 
from the complete object surface. For example, the axis of a femur shaft or an angle 
5 between two vertebral endplates are geometrical properties defined by parts of the 

object, which are difficult to specify by a human operator in an accurate and reproducible 
fashion. Such methods are very well adapted to extract the surface of the object, 
providing all necessary information concerning the surface of the object. However, there 
are a great number of measurements of geometrical properties which cannot be derived 
10 from the object surface. For example, a center of a femur head or an axis of a femur 
shaft of the femur are geometrical properties which cannot be directly derived from the 
complete object surface. 

It is an object of the present invention to provide a method for determining geometrical 
15 properties of a structure of an object displayed in an image, allowing automated 
measurements of geometrical properties of objects. 

In accordance with the present invention, this object is solved with a method for 
determining geometrical properties of a structure of an object displayed in an image 
20 comprising the steps of adapting a deformable surface model to the object, applying 
additional geometrical information to the adapted deformable surface model of the 
object, and extracting the geometrical properties of the structure of the object from the 
adapted deformable surface model to which additional geometrical information has been 
applied. 

25 

According to the present invention, due to the integration of additional geometrical 
information into the deformable surface model, geometrical properties of the objects can 
advantageously automatically be measured. Furthermore, the present invention allows to 
derive geometrical properties from a surface of an object which have a definition based 
30 on sub-parts of the object. For example, the present invention allows to automatically 



PHDE020179 EP~P 

-3- 



extract a center of the femur head, whereas, only the surface of the whole femur is 
displayed. Due to the integration of additional geometrical information, diagnosis and 
treatment of a patient can be carried out more precisely. 

5 Claim 2 describes an exemplary embodiment of the method of claim 1, wherein surface 
elements belonging to a particular sub-part of the object are identified. Due to the 
identification of surface elements of sub-parts of the object, particular sub-parts of the 
object may be recognized automatically. For example, by identifying surface elements in 
the model belonging to the femur head, a femur head in an unseen image can be 
10 automatically identified and the boundaries of the femur head can be identified. 

According to the exemplary embodiment of claim 3, geometrical properties of the object 
are derived on the basis of the geometrical primitive. Advantageously, this allows a very 
simple procedure to identify geometrical properties of the object which are not based on 
1 5 the surface of the object. For example, the center of the femur head is identified from 
coordinates and parameters of the sphere fit to the femur head. Advantageously, a 
computation time is minimized. 

The exemplary embodiment of the present invention according to claim 4 describes a 
20 preferred way to identify surface elements of the deformable model belonging to a 
particular sub-part of the object. 

Another exemplary embodiment of the present invention in accordance with claim 5, 
relates to a method for determining a deformable model for adaptation to an object, 
25 allowing the determination of a model which enables the automated measurement of 

geometric properties of objects when applied to an object. Furthermore, this method is a 
simple method for determining a deformable model which enables a highly accurate 
adaptation of the model to the object. 



30 
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Advantageously, according to another exemplary embodiment of the present invention as 
set forth in claim 6, surface elements belonging to sub-parts of the object are selected 
and labelled. This allows a simple and efficient reconnaissance of sub-parts of the object 
and an identification of surface elements belonging to these sub-parts requiring a 
5 minimized number of calculations when the model is applied to a new object in an image. 

According to yet another exemplary embodiment of the present invention as set forth in 
claim 7, a simple method is provided allowing an efficient determination of a 
transformation rule for fitting the geometric primitive into the surface model. 

10 

In claim 8, an exemplary embodiment of an image processing device for executing the 
method according to an exemplary embodiment of the present invention is described and 
claim 9 describes a computer program for such an image processing device. 

15 As apparent from the above explanations and the following description, it is the gist of 
the present invention to integrate additional geometrical information into a deformable 
model, which model is then applied to an object displayed in an image, wherein, for 
determining geometrical properties of the structure of the object, the additional 
geometrical information is used. The geometrical properties may be included into the 

20 model by identifying and labelling sub-parts (e.g. surface elements of a mesh such as 
triangles) of the surface model and fitting geometric primitives (e.g. a sphere to the 
femur head) to these sub-parts in order to represent the geometrical properties. Since 
the number of surface elements (here the number of triangle) of a sub-part remains 
constant during adaptation of the surface model to the object, and the triangles reach the 

25 same anatomical location for individual objects, the adaptation of a label deformable 
model to an unseen image advantageously allows to identify the sub-parts on the unseen 
object surface based on a one-to-one point correspondence between original and adapted 
mesh. 
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These and other aspects of the invention will be apparent from and elucidated with the 
reference to the exemplary embodiments described hereinafter. The following exemplary 
embodiments of the present invention will be described with reference to the Figures. 

5 Fig. 1 shows a schematic representation of an exemplary embodiment of an image 

processing device suitable for executing an exemplary embodiment of the method 
according to the present invention. 

Fig. 2 shows a flow chart of an exemplary embodiment of a method for determining an 
10 extended deformable surface model according to the present invention. 

Fig. 3 shows a flow chart of an exemplary embodiment of the method according to the 
present invention. 

15 Fig. 4 shows an image of a vertebra model determined with a method according to an 
exemplary embodiment of the present invention applied to a vertebra. 

Fig. 5 shows an exemplary embodiment of an adaptation of a surface model according 
to an exemplary embodiment of the present invention to an image of a vertebra 
20 and the fitting of a plane to the top endplate of the vertebra in accordance with 

an exemplary embodiment of the present invention. 

Fig. 6 shows an exemplary image of a femur head, wherein the surface elements 

belonging to a sub-part of the femur have been labelled, in accordance with an 
25 exemplary embodiment of the present invention. 

Fig. 7 shows an image of a femur wherein primitives were fit to sub-parts of the femur, 
in accordance with an exemplary embodiment of the present invention. 
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Fig. 8 shows an image wherein geometric properties of the femur are derived from the 
geometric primitive, in accordance with an exemplary embodiment of the present 
invention. 

5 Figure 1 depicts an exemplary embodiment of an image processing device according to 
the present invention, for executing an exemplary embodiment of a method in 
accordance with the present invention. The image processing device depicted in Fig. 1 
comprises a central processing unit (CPU) or image processor 1 connected to a memory 
2 for storing a deformable model and an image depicting an object. The image processor 

10 1 may be connected to a plurality of input/output-, network- or diagnosis-devices such 
as an MR device or a CT device. The image processor is furthermore connected to a 
display device 4 (for, e.g. a computer monitor) for displaying information or images 
computed or adapted in the image processor 1 . An operator may interact with the image 
processor 1 via a keyboard 5 and/or other output devices which are not depicted in 

15 Fig. 1. 

Figure 2 shows a flow chart of an exemplary embodiment of a method for determining 
an extended deformable model for adaptation to an object in accordance with the present 
invention. After an initialisation in step 50, in step 51, a surface model of the object 

20 wherein the surface model describes a surface of the object is generated. According to 
the present exemplary embodiment, the surface is represented by a polygonal mesh, 
where vertices Xi are connected with edges. Here, a triangular mesh is used, but other 
representations such as simplex or general polygonal meshes are possible. The surface 
representation can be derived by a common triangulation method of a simple training 

25 object, for example as suggested by W.R Lorensen et al. '*Marching cubes: A high 
resolution 3d surface construction algorithm" Computer Graphics, 21(3): 163-169, 
1987. Instead of a single surface triangulation, it is also possible to use a statistical 
shape model, such as suggested by T.F. Cootes "Active shape model- 'smart snakes', in 
British Mach. and Vision Conf., pp. 266-275, 1992. 

30 
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After generating the surface representation, i.e. the deformable surface model, additional 
geometric properties are integrated into the deformable surface model in step 52. 

Step 52 comprises a step 53 wherein surface elements belonging to sub-parts of the 
5 object are identified. If the example of a femur is used, sub-parts of the femur are for 
example a femur head, a femur shaft etc. The sub-parts, i.e. the subdivision of the object 
into sub-parts, depends on which measurements are of interest. If, for example, a center 
of the femur head is of interest, preferably the femur is sub-divided into a femur head and 
a femur shaft. Then, in a following step 54, surface elements of the surface model, i.e. 

10 the triangles of the mesh, are labelled in accordance with the respective sub-part of the 
object to which they belong. As label, for example, integer numbers can be attached to 
the respective triangles. The triangles are labelled such that all triangles belonging to the 
same sub-part have the same label. This can for example be carried out by a physician 
with an interactive display and a pointing and selection device or with a corresponding 

15 selection method. However, it is also possible to use a pattern recognition algorithm for 
identifying and labelling sub-parts of the object for the geometric property to be 
measured. 

Then, in step 55, a suitable geometric primitive is selected in accordance with the 
20 measurement to be carried out and a form of the respective sub-part. For example, when 
the center of the femur head is to be determined, a sphere is selected. Also, when the 
axis of the femur shaft is to be detected, a straight line is selected as geometrical 
primitive. This can be done by a physician or a suitable pattern recognition method. 

25 Then, in step 56, the geometric primitive is fit into the surface model, i.e. the geometric 
primitive is fit to the surface elements of the respective sub-part of the object. The 
primitive can be fitted to the triangles of the mesh labelled as belonging to a particular 
sub-part, by for example minimizing orthogonal distances between the triangle 
coordinates and the primitive surface in the least-square sense. Examples for such fitting 

30 methods are described in D. Eberly, "Least squares fitting of points", Technical report, 
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Chapel Hill, NC, USA, 2001 and H. Hoppe et al., "Surface reconstruction from 
unorganized points" Computer Graphics (SIGGRAPH '92 Proceedings), 26(2):71-78, 
1992. 

5 Then, in a step 57, a rule is determined for mapping the geometric primitives onto the 
sub-parts. In the present exemplary embodiment, the rule consists of the particular 
primitive for the particular sub-part and of the method for fitting the primitive to the sub- 
part. 

1 0 Then, after the execution of step 52, which comprises steps 53-57, the method continues 
to step 58, where it ends with a finished extended deformable surface model. In 
distinction to known deformable surface models, this extended deformable surface model 
comprises additional geometrical information relating to, for example, which triangles of 
the surface mesh belong to a particular sub-part of the object of interest, which primitive 

1 5 fits to the form of this particular sub-part and which method is to be used for fitting this 
primitive to the particular sub part. 

In the following, with reference to the flow chart of Fig. 3, an exemplary embodiment of 
the method for detennining geometrical properties of a structure of an object displayed 
20 in an image, in accordance with the present invention is described. After initialisation in 
step 100, in a step 101, an extended deformable model in accordance with the structure 
of the object in the image I containing the structure of interest is loaded. The extended 
deformable model M is described as Mfo Si, R) and may have been determined in 
accordance with the flow chart described with reference to Figure 2. 

25 

Li the following steps 102 and 103, an adaptation procedure is carried out that results in 
varying the positions of the deformable surface model, so that it optimally fits the 
surface of the object of interest in the image. Procedures for. adapting the deformable . 
surface model to the surface of the object are known for example from J. Weese et al. 
30 "Shape constrained deformable models for 3D medical image segmentation" 17 th 
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International Conference on Information Processing in Medical Imaging (D?MI), pages 
380-387, Davis, CA, USA, 2001, Springer Verlag or from T. Mclnerney et al. 
<c Deformable models in medical image analysis: A survey" in Medical Image Analysis, 
1(2):91-108, 1996. 

5 

The method of Weese et al. can be summarized as follows: In step 102, for each of the 
triangles, a search along the triangle normal is carried out to find a point xj that 
potentially lies on the boundary of the object in the image. From these surface points, an 
energy function is formulated. A minimization of the energy is carried out in step 103. 
10 The results are found vertex coordinates which reflect a tradeoff between being close to 
the boundary points and staying similar to the initial deformable model. From these new 
triangle coordinates, new boundary points are searched for in step 102, and so forth. 
Steps 102 and 103 are iterated a fixed number of times, leading to a deformed model 
close to the surface of the object of interest. 

15 

In the following steps 104 and 105, the actual measurement of the geometric properties 
of the object is carried out. 

In step 104, a subset of vertices or triangles xj is extracted that defines the geometrical 
20 measurement to be carried out. This will be described with reference to the exemplary 
images shown in Figs. 4 and 5. Fig. 4 shows a vertebra to which the extended 
deformable surface model has been applied and Fig. 5 is an image showing the surface 
mesh of the extended deformable surface model and the primitive, here a plane, fit to the 
top endplate of the vertebra. In the example shown in Figs. 4 and 5, a position or 
25 orientation of the plane of the vertebra end plate is to be measured. Therefore, triangles 
that belong to top of the vertebra endplate are extracted, i.e. identified. 

During adaptation of the deformable model to the object in steps 102 and 103, all 
triangles reach the same geometric location on the object, as on the training object. This 
30 means, a triangle that was located on the top endplate of the model before adaptation, 
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will always be on the top endplate after adaptation to the new object. Also, the number 
of triangles that belong to the particular sub-part, here to the top endplate, remains 
constant during adaptation. These two facts together are called "one-to-one point 
correspondence" between original and adaptation. 

5 

Due to the one-to-one point correspondence, when applying the extended deformable 
surface model determined in accordance with the method described with reference to 
Fig. 2, the triangles belonging to a particular sub-part of the objects can be easily 
recognized. By this, an automatic reconnaissance of sub-parts of the object, such as the 

10 top endplate of a vertebra, is possible. In detail, in step 104, information relating to 
which triangles are part of the surface of which sub-part is applied as additional 
geometrical information to the surface model which has been adapted to the surface of 
the object in the image. This additional geometrical information is applied to the adapted 
deformable surface model by using the labels of the triangles which are part of the 

15 extended deformable surface model. As shown with the darker surface of the top 

endplate in Fig. 4, all triangles of the surface mesh adapted to the surface of the object 
which belong to the top endplate of the vertebra where identified. Then coordinates of 
these labelled triangles are determined. 

20 This step 104 advantageously allows to automatically identify particular sub-parts of an 
object in a new image. This ability significantly facilitates the work of a physician. For 
example, in complex structures such as the brain, particular parts thereof can be 
recognized more easily and more accurately. This ability is also useful for the planning 
and rapid prototyping of prostheses, e.g. of femur prostheses. 

25 

Having extracted coordinates of the triangles of a particular sub-part, the method 
continues with step 105, where parameters representing geometric properties are 
estimated. In the examples of Figures 4 and 5, the parameters representing the . 
geometric properties are a point pn and the normal pi2 of the plane fit to the top endplate 
30 of the vertebra. To do this, additional geometrical information, here the rule relating to a 
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particular geometric primitive and a method for fitting the geometric primitives to the 
coordinates of the labelled triangles is applied to the deformable surface model which 
was adapted to the surface of the object in the image. 

5 The rule for estimating these parameters, given the coordinates of the triangles is given 
by the extended deformable model loaded in step 101. As already indicated above, the 
rule consists of a particular geometric primitive (here a plane) and a method for fitting 
the geometric primitives to the coordinates of the labelled triangles. 

10 Then, in step 105, the respective geometric primitive, here the plane, is fit to the 

coordinates of the labelled triangles belonging to the top end plate of the vertebra, by, 
for example, minimizing the orthogonal distances between the triangle coordinates and 
the surface of the geometrical primitive in the least-square sense. 

15 After the orthogonal distances are minimized, coordinates of a point pn and the normal 
p 12 of the plane are known, which may be output as the geometric properties. 

In brief, according to the method described with reference to Fig. 3, a deformable 
surface model as known in the art is adapted to the surface of the object of interest in the 

20 image. This means that positions of triangles of a surface mesh are altered until the 
triangles "lie" on the surface of the object. Then, additional geometrical information is 
applied to the adapted surface mesh: The triangles belonging to a particular sub-part of 
the object are identified, e.g. labelled with a respective integer number, and the 
geometrical primitive is fit to the labelled triangles. The geometrical primitive and the 

25 method for fitting the geometrical primitive to the labelled triangles are part of the 

extended deformable surface model loaded in step 101. On the basis of the coordinates 
of the fitted primitive and the properties of the primitive, the desired geometrical 
properties are determined. 



30 
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Figures 6, 7 and 8 show another example for automated geometric measurements in 
accordance with an exemplary embodiment of the present invention. In Fig. 6, an 
extended deformable model determined in accordance with the present invention was 
applied to an image of a femur. In the extended deformable model, the femur head was 
5 labelled, the femur neck was labelled and the beginning of the shaft was labelled. Thus, 
due to the one-to-one point correspondence between original and adapted mesh, the 
femur head is identified and all surface elements of the mesh belonging to the femur head 
are labelled with the same label and recognized automatically. Also, the femur neck and 
the femur shaft were automatically identified and all surface elements belonging to the 
10 femur neck and the femur shaft were labelled accordingly. 

In Fig. 7, in accordance with the rule formulated in the deformable model, suitable 
primitives were fit to the respective surface elements labelled in accordance with the 
respective sub-part. Here, a sphere was fit to the surface elements of the femur head, a 
15 straight line was fit to the respective surface elements of the femur neck and another 
straight line was fit to the surface elements belonging to the femur shaft. 

Then, here indicated with Fig. 8, automatically, a center of the femur head, a direction 
location of the axis of the femur neck and a location and orientation of the femur shaft 
20 can be derived directly from the two straight lines and the sphere by just using the 
parameter of these primitives. 

Accordingly, the present invention enables the extraction of geometric properties of an 
object which are not directly defined by the surface of the object. 

25 

Exemplary embodiments of the above methods and device may advantageously be used 
for orthopaedic diagnosis and treatment (for example, to define and measure geometric 
properties of bones etc.) or cardiac imaging (for example, exacting the location of 
specific axes required for scan-plane-planning in MR). 

30 
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1. Method for determining geometrical properties of a structure of an object displayed in 
an image, comprising the steps of: 

(a) adapting a deformable surface model to the object; 

(b) applying additional geometrical information to the adapted deformable 
5 surface model of the object; and 

(c) extracting the geometric properties of the structure of the object from the 
adapted deformable surface model to which additional geometrical information has been 
applied. 

10 2. Method according to claim 1, wherein step (b) of applying additional geometrical 

information to the adapted deformable surface model of the object further comprises the 
steps of: 

identifying surface elements of the deformable surface model relating to a 
particular sub-part of the object; and 
15 fitting a geometric primitive to the surface elements relating to the particular sub- 

part of the object in the deformable surface model, the geometric primitive having a form 
corresponding to a form of the particular sub-part. 

3. Method according to claim 2, wherein the geometrical properties of the object are 
20 extracted on the basis of the geometrical primitive. 

4. Method according to claim 2, wherein the surface elements of the particular sub-part 
of the object, are identified by means of labels assigned to the surface elements belonging 
to the particular sub-part. 
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5. Method for determining an extended deformable surface model for adaptation to an 
object, comprising the steps of: 

(a) determining a deformable surface model of the object, wherein the 
deformable surface model describes a surface of the object; and 
5 (b) integrating additional geometrical information into the deformable surface 

model. 



6. Method according to claim 5, wherein step (b) of integrating additional geometrical 
information into the deformable surface model further comprises the steps of: 

10 selecting surface elements of a plurality of surface elements of the deformable 

surface model which belong to a sub-part of the object; 

labeling the surface elements of the plurality of surface elements of the 
deformable surface model such that surface elements which belong to the same sub-part 
have the same label. 

15 

7. Method according to claim 6, wherein step (b) of integrating additional geometrical 
information into the deformable surface model further comprises the steps of: 

selecting a geometrical primitive in accordance with a form of the sub-part; and 
determining a rule which maps the geometric primitive onto the surface elements 
20 of the plurality of surface elements of the deformable surface model. 



8. Image processing device, comprising: 

a memory for storing a deformable model and an image depicting an object; and 
an image processor for determining geometrical properties of the object, which 
25 processor performs the following operation: 

(a) adapting a deformable surface model to the object; 

(b) applying additional geometrical information to the adapted deformable 
surface model of the object; and 
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(c) extracting the geometric properties of the structure of the object from the 
adapted deformable surface model to which additional geometrical information has been 
applied. 

5 9. Computer program for an image processing device in accordance with claim 8, for 
determining geometrical properties of an object, comprising the following steps: 

(a) adapting a deformable surface model to the object; 

(b) applying additional geometrical information to the adapted deformable 
surface model of the object; and 

10 (c) extracting the geometric properties of the structure of the object from the 

adapted deformable surface model to which additional geometrical information has been 
applied. 



15 
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Automated Measurement of Objects Using Deformable Models 

The present invention relates to the field of digital imaging, in particular to the field of 
estimating geometrical properties of an anatomical object. According to the present 
5 invention, geometrical properties are automatically measured and geometrical properties 
which have a definition based on sub-parts of the object are derived. To do this, 
additional geometrical information is integrated into a surface model Geometrical 
properties are included into the surface model by identifying and labelling sub-parts of 
the surface model and fitting geometric primitives to these sub-parts. This 
10 advantageously allows to identify these sub-parts on an unseen object surface and to 
automatically extract relevant geometric properties. 
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